The Tie between Action and Language Is in Our Imagination

In this thesis, the embodied cognition proposal that action words are directly and automatically mapped into the perceiver\u2019s sensorimotor system, and understood via motor simulation, has been put under the lenses of neuropsychology, psychophysics, transcranial magnetic stimulation (TMS), and functional magnetic resonance imaging (fMRI) investigation. The objective was to establish whether the tie between language understanding and motor simulation is necessary for the former to be effective, to the extent that a virtual identity can be recognized between action and language systems..

Converging evidence that left extrastriate body area supports visual sensitivity to social interactions

Navigating our complex social world requires processing the interactions we observe. Recent psychophysical and neuroimaging studies provide parallel evidence that the human visual system may be attuned to efficiently perceive dyadic interactions. This work implies, but has not yet demonstrated, that activity in body-selective cortical regions causally supports efficient visual perception of interactions. We adopt a multi-method approach to close this important gap. First, using a large fMRI dataset (N=92), we found that the left-hemisphere Extrastriate Body Area (EBA) responds more to face-to-face than non-facing dyads. Second, we replicated a behavioural marker of visual sensitivity to interactions: categorisation of facing dyads is more impaired by inversion than non-facing dyads. Third, in a pre-registered experiment, we used fMRI-guided transcranial magnetic stimulation to show that online stimulation of the left EBA, but not a nearby control region, abolishes this selective inversion effect. Activity in left EBA, thus, causally supports the efficient perception of social interactions

The processing of actions and-action words in Amyotrophic Lateral Sclerosis patients

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disease with prime conse- quences on the motor function and concomitant cognitive changes, most frequently in the domain of executive functions. Moreover, poorer performance with action-verbs versus object-nouns has been reported in ALS patients, raising the hypothesis that the motor dysfunction deteriorates the semantic representation of actions. Using action-verbs and manipulable-object nouns sharing semantic relationship with the same motor represen- tations, the verb-noun difference was assessed in a group of 21 ALS-patients with severely impaired motor behavior, and compared with a normal sample's performance. ALS-group performed better on nouns than verbs, both in production (action and object naming) and comprehension (word-picture matching). This observation implies that the interpretation of the verb-noun difference in ALS cannot be accounted by the relatedness of verbs to motor representations, but has to consider the role of other semantic and/or morpho- phonological dimensions that distinctively define the two grammatical classes. More- over, this difference in the ALS-group was not greater than the noun-verb difference in the normal sample. The mental representation of actions also involves an executive-control component to organize, in logical/temporal order, the individual motor events (or sub- goals) that form a purposeful action. We assessed this ability with action sequencing tasks, requiring participants to re-construct a purposeful action from the scrambled pre- sentation of its constitutive motor events, shown in the form of photographs or short sentences. In those tasks, ALS-group's performance was significantly poorer than controls'. Thus, the executive dysfunction manifested in the sequencing deficit ebut not the selec- tive verb deficite appears as a consistent feature of the cognitive profile associated with LS. We suggest that ALS can offer a valuable model to study the relationship between (frontal) motor centers and the executive-control machinery housed in the frontal brain, and the implications of executive dysfunctions in tasks such as action processing

The Origin of Word-related Motor Activity

Conceptual processing of verbs consistently recruits the left posterior middle temporal gyrus (lpMTG). The left precentral motor cortex also responds to verbs, with higher activity for action than nonaction verbs. The early timing of this effect has suggested that motor features of words' meaning are accessed directly, bypassing access to conceptual representations in lpMTG. An alternative hypothesis is that the retrieval of conceptual representations in lpMTG is necessary to drive more specific, motor-related representations in the precentral gyrus. To test these hypotheses, we first showed that repetitive transcranial magnetic stimulation (rTMS) applied to the verb-preferring lpMTG site selectively impoverished the semantic processing of verbs. In a second experiment, rTMS perturbation of lpMTG, relative to no stimulation (no-rTMS), eliminated the action–nonaction verb distinction in motor activity, as indexed by motor-evoked potentials induced in peripheral muscles with single-pulse TMS over the left primary motor cortex. rTMS pertubation of an occipital control site, relative to no-rTMS, did not affect the action–nonaction verb distinction in motor activity, but the verb contrast did not differ reliably from the lpMTG effect. The results show that lpMTG carries core semantic information necessary to drive the activation of specific (motor) features in the precentral gyrus

The role of the right temporoparietal junction in perceptual conflict: detection or resolution?

The right temporoparietal junction (rTPJ) is a polysensory cortical area that plays a key role in perception and awareness. Neuroimaging evidence shows activation of rTPJ in intersensory and sensorimotor conflict situations, but it remains unclear whether this activity reflects detection or resolution of such conflicts. To address this question, we manipulated the relationship between touch and vision using the so-called mirror-box illusion. Participants' hands lay on either side of a mirror, which occluded their left hand and reflected their right hand, but created the illusion that they were looking directly at their left hand. The experimenter simultaneously touched either the middle (D3) or the ring finger (D4) of each hand. Participants judged, which finger was touched on their occluded left hand. The visual stimulus corresponding to the touch on the right hand was therefore either congruent (same finger as touch) or incongruent (different finger from touch) with the task-relevant touch on the left hand. Single-pulse transcranial magnetic stimulation (TMS) was delivered to the rTPJ immediately after touch. Accuracy in localizing the left touch was worse for D4 than for D3, particularly when visual stimulation was incongruent. However, following TMS, accuracy improved selectively for D4 in incongruent trials, suggesting that the effects of the conflicting visual information were reduced. These findings suggest a role of rTPJ in detecting, rather than resolving, intersensory conflict

Effects of TMS on Different Stages of Motor and Non-Motor Verb Processing in the Primary Motor Cortex

The embodied cognition hypothesis suggests that motor and premotor areas are automatically and necessarily involved in understanding action language, as word conceptual representations are embodied. This transcranial magnetic stimulation (TMS) study explores the role of the left primary motor cortex in action-verb processing. TMS-induced motor-evoked potentials from right-hand muscles were recorded as a measure of M1 activity, while participants were asked either to judge explicitly whether a verb was action-related (semantic task) or to decide on the number of syllables in a verb (syllabic task). TMS was applied in three different experiments at 170, 350 and 500 ms post-stimulus during both tasks to identify when the enhancement of M1 activity occurred during word processing. The delays between stimulus onset and magnetic stimulation were consistent with electrophysiological studies, suggesting that word recognition can be differentiated into early (within 200 ms) and late (within 400 ms) lexical-semantic stages, and post-conceptual stages. Reaction times and accuracy were recorded to measure the extent to which the participants' linguistic performance was affected by the interference of TMS with M1 activity. No enhancement of M1 activity specific for action verbs was found at 170 and 350 ms post-stimulus, when lexical-semantic processes are presumed to occur (Experiments 1–2). When TMS was applied at 500 ms post-stimulus (Experiment 3), processing action verbs, compared with non-action verbs, increased the M1-activity in the semantic task and decreased it in the syllabic task. This effect was specific for hand-action verbs and was not observed for action-verbs related to other body parts. Neither accuracy nor RTs were affected by TMS. These findings suggest that the lexical-semantic processing of action verbs does not automatically activate the M1. This area seems to be rather involved in post-conceptual processing that follows the retrieval of motor representations, its activity being modulated (facilitated or inhibited), in a top-down manner, by the specific demand of the task